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^he primarypurpose of this p to prisent ^ 

evidence of significant differences in the effectiveness of schools 
serving low-income childi^eh^ a secondary purpose is to show that one 
reason wfi^ place in some classrooms and schools 

thffi in others his^^t^ with diif erences in^the ef f ecti\rehess of 
teachers due to teaching experience and "vintage effects; "Three 
samples of black second and third graders in New Haven were tested in 
readin^and math' at the beginning and end of the school year. 
Significant differences were found in the amount of liearning taking 
place in different schools and different classrooms^ even after 
taking into account the skill levels and famii^y background each chiTd 
brought to schobl. .Findings also showed that, in all three samples, 
teachers with 3 to 5 years experiende were more effective than 
teachers with le^ss experience experience ^ beyond the 5 
years^ fiowfever^ didvhot in^ but reduced it 

slightly; Farther investiga^ large midt*esterg • 

city showed this apparent declineto be a research, artifact produced 
by "vintage effects" (i^ quality of 

teacher hired at times of increasing enroiiment and t^^^ , 
quality of those hired at times of declining enrollment. (CMG) 
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• view or opiriipis stated in th.is.d.QciL 
. '^^!^\^9 ?P' necessarily represent official NiE 
position or.polic?. ; 
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'^A®-?™^^ P^T'tt'^'fJafief is to present evidence of signifi- 
cant differences in' Pilpl^eless.if scjiools- serving Jow-income 
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^Ifi^SI^K. scfiool experiencsdo 

, . A secon(^ry goal of tl]e!^i^p|i^diMf|^^ why inbre 
learning^takey)lace in sonm^ 
Thisjeason concerns differeiMffii| effeefeess bleachers diie 
to teaching experience and "|||||jfecfs: |1i||cqridpart of the 
paper explains thes^ pheMme?jaiMiistrat& tha^ey are related 



are. 

To talk to professional educators abou||TOpc: |fiQols^|jiaire a_ " 
difference is a littpke b|ingi|ig ic|||t^plini^,' Sii^p one of . 
the ipotivatioiis th^ laj'ph bl'^biilw 
is the belief that the qualify of fori||l|^||ateiii^^^^^^ pei\||as 
a significant impabt, on tfer jivK JidAatSicay 
0* ented educators can make a^iffereiit«j;^^::^f . ) ^ ^ 

.j^ It is important to r^membef|jJioweferi' t^ : ■ 

m """"" — 



under significantchallenge in recent years; Central to this challenge 
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.appiicaoie answers to the (mention 
/V).. of how to provide all American chilijreii 'with jthe cognitive and 
^ affectiveskills needed to function effectivejf bursoci^tjr! Looking 
(Q back from 1980 with the perspective of 15 |ears of extensive experi- 
I Q mentation and efforts to find universally applicable sblutlons to the 



Innef'Ctty Schobi9/Can;Make a Difference 



iDlem-it that we ever 

■ . proBlerji would befeS^ to solve or thaHhere could be universal solu- 
vfions: Hpwevefj^o^^^ M only read tlie publicity that surfbunded 
the passagp of jfie to 
; t0 understand the optirnism present at that time. Wany observ'ejs 
JaM^^ 



^~7lih"6oS to dei^lo]) powerful programs that would effectively cpm- 
■ : ..perisate for the disadvantages childjen from poor families often 
:' ; bHng with theni to; school Research strategies we^^ designed to 
: ■ identify the most succ^sful of' these prbgraifis and^i^tensive efforts > 
' ;Ay'eremadetoex[^^ : 
V Fifteen years later we know that there are inde^ successful school / ; 
:. -^^^ Bxbmely difficult to / ^ 

replicate these successes in other communities, in differisnt schools / , 
,y uithjii the same boiiimuni 

Ifi which the success was brigina^^ v, ;. 

. J^fli^iven these frustrations!, ^drne dbsera^ have cdncli<ded that di^ 
?:^^p|nces in the skill levels of children are due solely to differences in . 
. ^f^ilv bae!|ro^ and other forces external to the school: They 
■ Veaso^^ time only 

; ' . becaukpiey 5er\'e children; who bring to school with them high lev- 
^'^■elsofmiiiiva^^^^^ - ; 

This vief^\|is cfellepjged bjf the research Iw^oiild now like to de- 
scribe. This fe$eaf(;hlhows clearly t^^ are large and jmpop 
tant differencfein fequality^ of education provided to children 
atteiidihg ihner-citfihools;, This evjlefiee provides clear support 
for the view that schools, matter and thaHt^ worthwhile to pdr^ae 
the difficult task of waking schools effecti^^^^^^^ providjng children 
with the skills needed to lead^rbto^^ ' 

The data base for jhe research describeiii ^ 
consists of information on three^mplK of Blak^d^^ ■ 
students in the second or third grade iii dSe df 15'ihher-cit)^^^ : 
tary schools in New Haven, Cbnnecticijt, dunngjtjie perioll^ ■ i; ■ 
\ 1972. Each sample consisted of more than 4(1] (Stldj^^^^ 

the school year in one of 40 self-contained classrooms; the in^o^ 'l*^ 
, tion available for each child included variables descnbm|the chii%J^ 
background and test scores from two standatdizejist^of ;re^^ 
: and mathematics. One tes} was adminlstered-at the beginning of the : , 
school year (br at the end of the previous school ycal) arid the other 
at the end of the school year. ' ' .. 



;Rlcfiard3:Wuniaine 

iThestrategv'ijsedwas ' 
Ifbnewantstopredi^^ 

year and one already knows the child's skill M 
^ the school year and information about the child s family ,ba^^ ; ■ 
■ ' ground, is it important to identify the ichc^ in which the child . , ' 
. jpent the' schdo l yearfls J ■ 
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within the scWP^e alternative. livpullieiesmrthabapprexF 
matelythe-sanie amount of iearning took place in each oftfie 15 , . 
inner-city seHools in the sample y . 'in the 40 second- and third-- ;: : 
grade classrobms within these schbdls/lrNhis case, there migjit be p 
differences in the average achievement levtlls of the children attend- • 
jngdifferent'schools,l)ut these:differe^^ ,. -U 

: information on th'e children's family; background arid by the skill 
levels that the children bronght with them b;school at the beginning 
' : of the school year. 

' The results of the statisticai analyses conducted toWjhese hy- 
- potheses provide clear evidence that there were signjfiSntdiffep 
■ ' ences in the ambunt of learning taking place in^ different schools and 
in different classrooms, even after takirig into account the skill levels 
and family backgroundlhat each child brought to school. These dif- 
; fetences were statistically significant for all three samples arid for 
skill leveis in reading and mathematics. In other words, children 
with simiiar ijackgroundsflnrf similar skilHevels at 
the school year were ml similar in how much they learned duiihg 
' the scliool year: their learning, depended significantly on u)/ilc/i 
. school they attended and, \vithin any school, on which ciass_room 
■ ' - ■ tlj^y were assigned to. Something about those schools and classrooms 
^ had significant effects on the children, V ., 

T^e next question to coasijeriSj How larfe were the difference* 
in the progress of students in different schools and iil different dass- 
rootns? To;^ddress this t^'O". useful tp examine one of the 
three pmpies in pail,/(The pattern of results for a^^^ 
esentially the same, j''The average reading jevel of the children in 
•the second-grade sample, expressed in pade eqaivalents, was 1.7 at 
the beginning of th^second grade. In other wbrds,^ the average skill 
level was equal to iat achieved by the average child nationaliyat 
the end of the seventh month of'the first grade. On averag^, the chil- 
dren in the second grade sample made Jeven months pf p 



'Stt' Miiriiaro ( l!i'5) for a wnipleic livlininil (Icsfriiition iif tiiis rwarcli, 
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' '. leachers'are signifieantly relafed'tb* student; 

^ ' achiet^ement; , This section of the pap ^fe^ 
7 ' founditobei^latedtoteacliiH^ 
rj/' eiice, and whaH call "vintage effe^^^^ • ■ ■ - . , , 



fejeio). 



■/ / 
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. . pie Of urban ffilioolssemng p^^ 
. naw turn tQ this topic. ; . • ' 



matter 
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\i , leirclicr experience t ; . 

y\ THeuhjr'poithesis that teachers become more effective as thej'' gain ex- 
; \ peirien(l rests pn the view that teaching is a complex prMe^s requir- 
\ ing a varied set pf skills; ^lianj^or^^ te leariiea qrt the 

V job:; In other words, teachers Iqarn to teacfi by .teaching,; and, as a 
I 'I result, thej/^b^^ ' ■ . 

^ i I found Strang siippdrtfor tJiis Hj^potfeisM research in New;- 
/ : Haveri; In all three samples, teachers with tHree:to fi^e yea of ex- 
'. periencewere more effective than teachers with less expriencg^ ' 
/ example, students#dasses taught by t^chen witl' three ft ve 
^ ^ years of experience male two to three mbnths more ptdgfess (mea- 
^ ;i sured in grade eqpi\;alents) in acquiring reading skills dunrig the 
school mr than students taught by fifs^^^^^^ teachers/The differ- . 
: ences in childrens progress in acquiring mathematics skills were . 
: , ' even larger, v v . - ' : 

The iitiplicatidns of these findings for policymaking depend to a . 
'.J-eat 'extent on th^ opportunities 'and constraints that individual - 
school districts and administrators face. However, there are two 
general, if obvious, iniplicatiohs. The first is that most first-year 
^ teachers need k great deal of help and encoaragemeiit and that it is. ' 
very important for them and their students that support be feadilj ^ 
available in a nonthreatening'form. The second implication is that 
great care should be taken to assure that the same children are hot 
assigned to fiKt^year.tea^^^^ . 
My research in New Haven 'did' not find th^t teachers became 
. ' more effective as they acquired .additional experience after the ini- 
. tial thr^Jb five^years of teaching. In fact, there Is weak evidence 
^ that teachers with morc'experience were slightly less effective; This 
could be due to'the much publicized phenomenon of teacher burn- 
out. Another partial explanation may be that very experienced . 
teachers make contributions to school effectiveness not reflected in 
the achievement^test score gains of their own students. For example, 
the*, ijiay hdp beginning teachers by providing them with instruc 
, tional matefials ahd advice on how to deal with difficult children. A ; 
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.^^^ m ^^ tHr^ to five years of experience is a 



reelects 



. W by distHcts at different points in lime THe 

ijostcompelling explanation |or iHe existence of vintage eff^ctsis 

.; he tet 25 j^ars have affected. the quality of new entrants to the 
• teaching profesibn^ I^' ^f'e late lO) and early 196^, a rapid in- 
^ cr^e ,n slu enrolments created an acute Shortage of fers 

■ ^^"^^'/"^dadifMttafin 

Due to the (^nibina^^^^^ of a decrease in the demand for teachers 
Wtatd by_declinin&e^ and an increase in the supply 

■ delayed response to the earlier shortage), there 
^" a surplus of teachers in most subject areas during t As 

^^a^ult,^hodldistrictshavebeenlletobev,^^ 

ing aniong the arge number of apfchts for teaching positions 
Assuming tl|at district personnel officJh are able to identify appi' 
cantswit^^hegreatest potential, the av^ragequaH^^ 
«rs should be higher in periods of excess supply, such as the 1970 s 

thanmperibdsofexcessdemand^suchastheearlv 1960s ■ ' ' 
^ Jintageeffectsareofinterestfortwore ;, 
labor market conditions for teachers influence the ability of school 
distncts to find high^uality teachers has implication < 

.....IPiesmhe future. Theseiiiiplications^ 

tion. Thejecond reason for interest iil'Wiitage effectsl that thev in- ' 
ueiKe the obseijed relationship betu^n teachingSperienceand' 
teadiii^performanceiThisinfluenceis^ 

; ^^"^toinvestigatetfeexperience.perforian^ . 

'"g^^-^nceon^teachingperf^^^^ 

pes^ofidrnduatteachm^ 

'^"'^(■*stead..themleofexpen^^^^^ 

.;e^^t|ng th«,^« ^ ^ . 

a.«ion of teachers. In olber words, data on teachers and stu: ^ 



A ' ; . 

* . Richard! Sutnane 

___''■* ■ " ■ ' ♦ 
are cbllected at one. point iiiihme, and theiictiven^ 
|eachenwhohavedtentl^ 

^ lyzed.Beimphcitasspptionuna^^^^^^ 
L^"f^fing for the effects of observable vari^ 
ground an ^raihin^ all the teach^ a re of equjp liH^ ^ 

-^feren-cesdue to experience. However, therViSyaM differ. 

• ences^in ability due to vintage effects that will.create bias in the esti. 
matwi relationship between teaching expenee and teaching per- 
formance. . ' - 

. IxMpIe may help to clarify this argument. Assume that all ^ 
^ehers ^19 b?com€ more effStive as they gain experience; We' 
biggest performance gains come in the initial years of teaching This 
IS itiostrated by curves AB and Gb in the figure beiow; both of^hith 
show the improi^emeiltin the performance of representative teach- 
ers as the teachers gain experience. 
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■ ■■■ The effects of Vintage are shown bj^^^ : 
■\ thehvocurv^.AHan^^ ' 

er hired'iii 1975 is more ef^eti\f than the tpaefe hired in ifc 
This differeiiee reflects' theiflt tjiat school districts could be mS 
: in: choosing ^ng apppc ant^in 1975 ; t han they'coiiid iii . ; 



ItlcliaidJ. 



teicfiinj performance^ 

■ teachers who^^ 1 and 11 years of experience at the end^bf it ' ; 
. iS%:dash^d jiiieCB t^^ is«tinild/fhus, if vinU^ ; 
itis possible to find no relal;icinship between teaching experience and ■ 
teaching performance^ in a cross sefitioS of teachers even if every , 
teajer improve with expeiiencei ' ■ , : . ; , / \' 

, Jhe liext step in my reearch was to examiiie ji^^ 
■vintage effeb:wer|^ ^ 

: in influencing" jhe|xperience-performance re^^^ ' - 

research strategs^,was to estimate, in thecbritextflfasihglestatistip^^^, 
mpdelj theeffeek onteachiiig perfbrriiance of both vintagelaiid ex- ■ : 

; perienaJn^tep of the figure on pap 37,>the goal was to estimate 
-the size of the^^vertical distance AC, th|^intage eff^t; and the ' 
charigirigdb^dfatherAB(Jr.CD,tHee^^^^^ 'S-;- 

; ^^^ ^[ariabie used-to indidate vintage effects was .the change in" : 

. trtal student fenrol^^^^ between thi^eariawhicha . 

. teacherii^tjaught in the Mrict and the previous year.. Theiogjc^ '; 

; underlying, the use of th||anab]e was thgtjn yearftf ra|id| ' l 
grbwing student enrdllm^^,:th^ 



■ ; approximately SOiOOO. students.: Enrollment gre ' 
the 1950*5 and more slowly daring the iM's; reaching a-^eak of , , 
: 48,009 students in ip; pf IS^ilroiteienb decr^^^ 
yingtojp()0syenfsinl97Siw|^ f 
a resu l t of these enrQllment shifts, this city hfe perieneetyar 



■■• (^fflpetingforteachers.in;the&!?^ 

bers of teachers at^meiniwliich the supp^^ was ^ 

■. Hvely limited.iA5'aTesijlV 
: . pong applicarits.,Wheii enrpifcerits were.declining';|e^^^^ 
; V ' ^ffireB could be jiipres^^^^^ : 

. ■ '1:'' :\'r- ;■^.:■.^%'V■■■^;^■^., 

■ ' : ^^^^^ ^Wi^rgecity in the Micfcest.' ieife 
.. . similar to thatused ipe Nef 
dents cgiisistedjof 325ilaci diijdren w'ho were^n tfeliiird or fourfl ^ ■ 

■ ^ pdein orieof i riiiiSbir of iiin^^^ ■ ' ^ ' ^ ' 
: ; . ;, This:data:fcase is p^rtieulaHy appfpate fortfie study of ^ ; ; 

■ 'effalbicaiiseintfe^ been' 

: ; ■ iarge^hah^ sdlool' enrliSeks 30'yeiirs^. . 

\ Diiring :the li^,>stydent^enr^^ reiitfily -stable at 
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changes ittheniinibebbf teaehws^ indifferent yeare andjnle > 
degree of seleetiyitv th^ 
r^jiipn^ongphc^nts.Cd^^ 



lifesufts of the rsearch indicate significant' vintage'effects. 
hirirhired in periods of rapidly growing ^nrdlliTientS' w&re less 
: . effective on average than teachers hired diirifig periods df enroll' 
'|erit declines; : 

■ ; The vintage effects alsd influenced the research results concerning 
the relationship betvyeen teaching experience and teaching pejor- 
.marice^Wheii-the e^^ of experience on perforiiiance were sti- 
mat^ w'ithouti controlling for vintage effects; no signifiMnt rela- 
tibnsiiip: Between teaching experience and teaching peprmance;: 
w^s fqiihd. However, when this relationship was reestimated', tak- 

y.ing vintage, ef^tsi^^^^^ pdsitive relationship 

j between teichirig experience and teaeh^ 
The size of the estimated coefficient, translated into grade 'equiva: 
lents, implies that childreii taiight by a teacher with five years of ex- 

■ periehcemake^ rridre mdnths of progres !ii acqiiiriiig 

readiBg5kills:during a school year than do children taught by a first-. 
vearJeacher;^ ' 



Vintage effects In tliefatare 
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the type of vintage effects described here coiitiiiues to liold iti the . ■ ;■ ; 
ichers hired in the'riext few years should be df high aver: ' ■ ■ " 
age quality, The reason is that enrollments will continue jolall over :. 
^ the next five .years and personnel officers will be able to select the^ ' ; |; t 
few h^w teachers needed from a lar^^^ ( V^ 

tant to keep in mind, hoivever, that the indicator of vintage ef|cf|\l : '■ 
in.this analp provides infoi-raation dnly;about the demand for m ^J; 
; it contains noinformation about the suppiy of teacher!.. ■ ; .;| -' 



'S'i; Miirhiirie ariil |'h.illi|» j IIJHI ) fiir a ci)iiipli:ii' ttthnical citwri j)li(in of ihis n^jiwtii. . 
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; liincrCityScfibolsCahHafe : ; " / i 

• Rewntly; evidence ha^^ been presented (Weaver, 1978) indi^ 
■ ■ tiiat tiie avwage qualitjf of the sfiidents preparing to be teachers has 



It is hot clear to wt 

" ■ ' • ■ , ■ _ ■♦■ , . _* 

the applicant pool, if it is asignificantdrop, will affect theqtiality of : , 
theteachers who are actaally hired. If teachers are chosen randomly .■ 
.from the applicant pool; the average quality t)f newly'hired teachers • . 
of course; fall; HDwever, if scRool districts fili thk relatively ; 

iinthdargeliQplbfaPijIi- 



cants, (he amage (jiiality heed hot fall and, in fact, hiav iiise. This 



rocess 



new 



IS especiaiiyimporiani loaay oecause 



over rate'amon^ teachers in most districts is so much: fer than it ; 
was in: the past. As a resultv^chool'districts have a ^igh 'probability " 
of experiencing for many yeats-both the benefits of particularly able , 
teachers and the costs of ineffective teachers, For these reasons-, iin- 
■prbvihg the process by/which applicahts|or teaching positions are 
.screened and new teachers chosen should have a high priority in the 
[resources^ "\ 



Richard J, Murodne 



' . Murnane, R. ], themjmiofschd^^^^^ tkleam^ojinncHjit] 

c/ii7iircn.Canibridgi;Mfe/:BalH^ 

, ' ,■ ' . ' . ' ■ ,„■ . 

' Mnrnane, R. & Phiilips, B. R. tearninj; by doing, vintage, an3 selection: 
• Three pieces of tb puzzle relating teacliln^ ■ 

publicatiori;,19Sl in Economi^oj 



Weaver, W. t Educators in supply and demand: M^^^^ Moo! 
H19?8j. 552-593.^ i ' ^ \ ■ , 



m tnis paper, ine first and most important tneme is that school ex- , 
■ periehces do' influence, the leSrnihg of ihher-city children.' Some ' 
inher-cit}'thildreri learri itiuch iiibre in school than other childreri 
: do, and this is due, at least in part, to differences in the quality; of 
in different schools and in different classrooms 
I same scnool, tlie second theme is.tlial the qdality of the 
teachitig stdff is one important determinant of the effec'tiveriess of 
. school programs; Consequent, it is important for school districts to 

ilicies- in 
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